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Abstract 

Introduction: Pre-hospital airway management is a controversial subject, but there is general agreement that a 
small number of seriously ill or injured patients require urgent emergency tracheal intubation (ETI) and ventilation. 
Many European emergency medical services (EMS) systems provide physicians to care for these patients while 
other systems rely on paramedics (or, rarely, nurses). The ETI success rate is an important measure of provider and 
EMS system success and a marker of patient safety. 

Methods: We conducted a systematic search of Medline and EMBASE to identify all of the published original 
English-language articles reporting pre-hospital ETI in adult patients. We selected all of the studies that reported ETI 
success rates and extracted information on the number of attempted and successful ETIs, type of provider, level of 
ETI training and the availability of drugs on scene. We calculated the overall success rate using meta-analysis and 
assessed the relationships between the ETI success rate and type of provider and between the ETI success rate and 
the types of drugs available on the scene. 

Results: From 1,070 studies initially retrieved, we identified 58 original studies meeting the selection criteria. Sixty- 
four per cent of the non-physician-manned services and 54% of the physician-manned services reported ETI 
success rates but the success rate reporting was incomplete in three studies from non-physician-manned services. 
Median success rate was 0.905 (0.491, 1.000). In a weighted linear regression analysis, physicians as providers were 
significantly associated with increased success rates, 0.092 [P = 0.0345). In the non-physician group, the use of 
drug-assisted intubation significantly increased the success rates. All physicians had access to traditional rapid 
sequence induction (RSI) and, comparing these to non-physicians using muscle paralytics or a traditional RSI, there 
still was a significant difference in success rate in favour of physicians, 0.991 and 0.955, respectively (P = 0.047). 

Conclusions: This comprehensive meta-analysis suggests that physicians have significantly fewer pre-hospital ETI 
failures overall than non-physicians. This finding, which remains true when the non-physicians administer muscle 
paralytics or RSI, raises significant patient safety issues. In the absence of pre-hospital physicians, conducting basic 
or advanced airway techniques other than ETI should be strongly considered. 



Introduction 

Airway compromise has been identified as a preventable 
cause of poor outcomes and death in trauma and cardiac 
arrest patients for many years [1,2]. After arriving in a hos- 
pital, the critical and complex intervention of emergency 
tracheal intubation (ETI) is usually provided by appropri- 
ately trained physicians. Most of these physicians are 
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trained anaesthesiologists or emergency physicians trained 
in anaesthesiology [3,4]. An in-hospital ETI intervention 
allows administration of drugs that optimize the condi- 
tions for tube insertion and minimize physiological 
derangement and other adverse events [4]. Unsuccessful 
or poorly conducted ETI can be life threatening and may 
result in significant complications, such as oesophageal 
intubation [5], hypoxemia [6], or post-induction cardiac 
arrest [7]. 

Rapid sequence induction (RSI) is generally accepted 
as the technique of choice for securing the airway in 
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seriously ill or injured patients [3,4]. RSI contains three 
elements: sedation, analgesia and muscle paralysis, all of 
which are necessary for a safe and successful ETI. The 
drugs used to perform ETI produce a state of apnoea, 
can induce hypotension and increase the risk of regurgi- 
tation. Using them requires a high level of competence 
and the ability to deal with any adverse effects. In hospi- 
tal settings, this requirement usually presupposes the 
educational level of a specialized physician. 

In a pre-hospital setting, the situation is somewhat dif- 
ferent. The first Medline- or EMBASE-indexed reports on 
pre-hospital ETI were published in the mid-to-latel960s 
[8-13]. Recently, the value of pre-hospital ETI has been 
seriously questioned [14-17]. Despite many published stu- 
dies, the benefits of this practice in different patient 
groups, the skills required by the providers, the effect of 
different techniques and the alternatives to intubation are 
less clear now than ever before. The majority of the pub- 
lished papers are based on observational methodologies 
and are usually considered to be low-quality evidence [18]. 
Despite the publication of guidelines from Europe and the 
US that recognize the need for appropriately conducted 
pre-hospital RSI [19-21] in a small number of patients, the 
practice is still widely variable between and within coun- 
tries. In many European countries in which specially 
trained physicians have participated in pre-hospital EMS 
services since the late 1950s, RSI is a core component of 
pre-hospital advanced life support [22-24]. In contrast, 
some pre-hospital EMS systems in developed countries 
base their advanced life support entirely on paramedics 
and/or nurses, and their ETI protocols and procedures 
depend far less on drug administration [25,26]. A recent 
systematic review extracted the Utstein airway template 
variables from studies pertaining to pre-hospital ETI [27]. 
The majority of the included studies (59.8%) were from 
North American EMS systems. Of these, 46 (78%) 
described services in which non-physicians conducted 
ETI. In contrast, physicians performed the pre-hospital 
ETIs in 13 (87%) of the 15 non-North American EMS sys- 
tems. Of the 47 non-physician-manned systems, 25 (53%) 
performed drug- assisted ETI [27] . 

As a complex intervention performed by operators 
with different skill levels in different ways on different 
patient groups, the effect of pre-hospital ETI on patient 
outcome is difficult to assess. However, the rate of suc- 
cessful placement of a tracheal tube into the trachea 
after attempted intubation, particularly after the admin- 
istration of a muscle paralytic, is recognized as a quality 
indicator for systems practicing ETI. Although muscle 
paralytics are administered to facilitate intubation they 
also render the patient apnoeic and, therefore, make the 
consequences of failed intubation much more serious. 

The aim of this project was to establish whether the 
published literature indicates a difference in ETI success 



rates between physician- and non-physician-manned 
EMS systems. We compared the success rates of non- 
physicians and physicians and those of non-physicians 
using different levels of drug assistance. Further, we 
wanted to explore whether there was a difference in ETI 
success rates between physicians and the sub-group of 
non-physicians using a muscle paralytic or a standard 
RSI. 

Materials and methods 

Identification and selection of studies 

We conducted a systematic search of Medline and 
EMBASE according to the Preferred Reporting Items for 
Systematic Reviews and Meta-Analyses (PRISMA) 
guidelines [28]. We identified all original English-lan- 
guage articles published prior to 1 September 2009 that 
pertained to pre-hospital ETI in adult patients [27]. The 
studies that investigated paediatric cohorts, that focused 
on surgical airways and that compared ETI to other air- 
way devices were excluded. The reference lists of the 
included studies and a recent relevant Cochrane review 
[17] were inspected to identify any additional relevant 
studies (see Table 1 for the search strategy). 

Study eligibility criteria and data extraction 

From the initial search, we selected all of the studies 
reporting ETI success rates. From these papers, we 
extracted information on the numbers of attempted 
ETIs and successful ETIs, type of provider, level of ETI 
training and drug availability on scene. The providers 
were categorized into two groups: physician and non- 
physician. The use of drugs was categorized into three 
groups: 1) no drugs available; 2) analgesics, anaesthetics, 

Table 1 Search strategy for identification of relevant 
studies in Medline and EMBASE 

Search terms 'keywords': 

Medline 'Emergency Medical Services' AND Intubation, Intratracheal' 

Embase 'emergency care' AND 'intubation/or respiratory tract 
intubation' 

Search terms 'title': 

Medline 'prehospital' AND 'intubation' 
'pre-hospital' AND 'intubation' 
'out-of-hospital' AND 'intubation' 
'prehospital' AND 'RSI' OR 'Rapid sequence induction' 
'pre-hospital' AND 'RSI' OR 'Rapid sequence induction' 
'out-of-hospital' AND 'RSI' OR 'Rapid sequence induction' 

EMBASE 'prehospital' AND 'intubation' 
'pre-hospital' AND 'intubation' 
'out-of-hospital' AND 'intubation' 
'prehospital' AND 'RSI' OR 'Rapid sequence induction' 
'pre-hospital' AND 'RSI' OR 'Rapid sequence induction' 
'out-of-hospital' AND 'RSI' OR 'Rapid sequence induction' 
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or a combination; and 3) muscle paralytics, with or 
without co-administration of analgesics and anaesthetics, 
or a standard RSI. 

Statistical meta-analyses 

The ETI success rates are reported as medians (range) 
unless stated otherwise. The individual and overall success 
rate is presented in a forest plot and the overall success 
rate was calculated using a random effects meta-analysis 
for proportions. The analysis did not consider the number 
of ETI attempts before success was achieved. 

To assess the relationships between the ETI success 
rate and provider type, and between the ETI success rate 
and types of drugs available on the scene, we performed 
a weighted univariate linear regression analysis with the 
ETI success rate as the dependent variable and drug 
availability and provider type as categorical independent 
variables. The regression was weighted by the size of 
each study, that is, by the number of intubation attempts. 
As all physicians use RSI (drug group '3'), a multiple 
regression model would have been degenerate and was 
not performed. All the tests were two-tailed, and statisti- 
cal significance was indicated by P < 0.05. 

The data were analysed using R 2.12 (The R Founda- 
tion for Statistical Computing, Vienna, Austria) [29]. 

Study ethics 

As a meta-analysis based on a systematic literature 
review, this study did not require approval from The 
Regional Committee for Research Ethics or the National 
Social Science Services. 

Results 

From 1,070 studies initially retrieved through the sys- 
tematic search, we identified 58 original studies that met 
the inclusion criteria. Of these, 45 (78%) were studies of 
non-physician-manned services (paramedic- or parame- 
dic/nurse-manned). Twenty-nine (64%) of the 45 non- 
physician-manned services and seven (54%) of the 13 
physician-manned services reported ETI success rates. 
The success rate reporting was incomplete in three stu- 
dies from non-physician-manned services, leaving 33 stu- 
dies for the final analysis (Figure 1). An overview of the 
included studies is shown in Additional file 1. 

In total, ETI was attempted in 15,398 patients: 2,536 
by physicians and 12,862 by non-physicians. The median 
(range) reported success rate was 0.905 (0.491, 1.000) 
(Figure 2). The estimated overall (95% CI) ETI success 
rate was 0.927 (0.882, 0.961). Figure 2 presents the indi- 
vidual study estimates and corresponding 95% CIs. 

When comparing physicians to non-physicians, the 
corresponding median (range) ETI success rates were 
0.991 (0.973, 1.000) versus 0.849 (0.491, 0.990). 



All seven physician-manned services reporting success 
rates also reported drugs available on the scene (all used 
standard RSI). Of the 26 non-physician-manned services 
reporting success rates, 19 (73%) reported drugs available 
on scene, leaving seven services reporting no use of drugs 
(drug group 1). Of the 19 services reporting use of drugs, 
six had analgesics, anaesthetics or a combination available 
(drug group 2), and 13 reported having muscle paralytics, 
with or without analgesics or anaesthetics, or standard RSI 
available (drug group 3). In drug groups 1, 2 and 3, the 
reported median (range) ETI success rates for non-physi- 
cians were 0.675 (0.491, 0.968), 0.810 (0.755, 0.905) and 
0.967 (0.758, 1.000), respectively. 

In weighted linear regression analysis, having physi- 
cian providers was significantly associated with an 
increased success rate: 0.092 (0.007, 0.176), P = 0.0345. 
Similarly, drug groups 2 and 3 were significantly asso- 
ciated with an increased success rate: 0.108 (0.033, 
0.183), P = 0.006 and 0.199 (0.147, 0.252), P < 0.001, 
respectively. 

When comparing physician to drug group 3 (muscle 
paralytics, with or without analgesics or anaesthetics, or 
standard RSI available) non-physician success rates, 
there still was a significant difference in favour of physi- 
cians: 0.991 (0.974,1.000) and 0.955 (0.758,0.990), 
respectively (P = 0.047). 

Discussion 

Airway management in pre-hospital care is complex. 
Although ETI is only required in a small number of criti- 
cally ill or injured patients [30,31], it is a well-established 
tool in pre-hospital EMS services. The procedure carries 
a risk of severe adverse events if not performed correctly 
[32] and its providers must be both technically compe- 
tent to perform the procedure and capable of making 
decisions and initiating treatments to prevent or treat 
complications. The ETI success rate is only one compo- 
nent of successful pre-hospital airway management, but a 
system that performs ETI should strive for a high success 
rate. 

This meta-analysis demonstrates that when non-physi- 
cians attempt pre-hospital ETI, they have significantly 
higher intubation failure rates than do physicians. The ETI 
failure rate of physician-manned services was on average 
one out of 100 patients, whereas services manned by non- 
physicians failed on average in 15 out of 100 patients. 

This overall comparison between physician- and non- 
physician-manned services is important. There is undoubt- 
edly considerable variation in the experience and skill levels 
covered by both the term physicians' and the term non- 
physicians'. The exposure to situations requiring ETI in the 
pre-hospital setting is, in most EMS services, relatively rare 
and it can be argued that it is often insufficient to maintain 
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Figure 1 Search diagram according to the PRISMA statement. 



necessary skills. Nevertheless, physicians operating in pre- 
hospital EMS are likely to have had more training and have 
performed a greater number of intubations than non-phy- 
sicians due to their in-hospital clinical activity. In the in- 
hospital setting, emergency physicians and anaesthesiolo- 
gists often perform emergency and elective intubations on 
a regular basis. 

Much more relevant to patient safety is the compari- 
son between physicians and non-physicians when mus- 
cle paralytics have been administered to facilitate 
intubation. Failure to achieve intubation after rendering 
a patient apnoeic has major safety implications and 



carries a risk of hypoxic brain injury and death [33]. 
Reports of ETI failure rates of over 15% after adminis- 
tering muscle paralytics are not uncommon in non- 
physician systems [34-36]. This high failure rate has 
been previously highlighted [37]; it is not only unthink- 
able in hospital practice, but is unacceptable in any 
area of practice. Even though the inclusion of muscle 
paralytics in non-physician-manned EMS services pro- 
viding ETI appears to significantly improve intubation 
success rates it also results in five patients in everylOO 
being rendered apnoeic with an unsecured airway after 
failed intubation. 
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Figure 2 Forest plot of 33 studies reporting success rate after pre-hospital emergency tracheal intubation. Individual study estimates of 
success rates and corresponding 95% CIs. 



The precise clinical implications of our findings are dif- 
ficult to assess. Failed intubations in hospitals have been 
subject to considerable analysis, which may give an indi- 
cation of the consequences of failed pre-hospital intuba- 
tion. A recent study [38] collected reports of major 
airway management complications during anaesthesia 



(death, brain injury, emergency surgical airway, and 
unanticipated intensive care unit admission) from all of 
the UK National Health Service hospitals over one year. 
Difficult or delayed intubation, failed intubation, and 
'can't intubate, can't ventilate' accounted for 39% of all 
such events. In a US study of 179 closed claims arising 
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from managing difficult airways, the majority (67%) of 
the incidents resulting in death or brain damage involved 
the induction phase of anaesthesia and were clearly asso- 
ciated with intubation difficulties [33]. It seems that failed 
intubation is closely associated with the most devastating 
complications of airway management. In healthcare risk 
assessment, the significance of a failed intubation and its 
consequences can be assessed by answering a few key 
questions [39]: what can go wrong; how bad is it; how 
likely is it to occur; and what can we do about it? We 
know what can go wrong in failed pre-hospital intubation 
and we know the consequences that fall into the poten- 
tially 'catastrophic' category (death or severe disability). 
When constructing a 'risk matrix', the only other key 
information required is the frequency or likelihood of the 
event occurring in a given system. The results of combin- 
ing the potentially severe consequences from failed intu- 
bation assisted by muscle paralytics and our observed 
frequency of failed intubation in 'non-physician systems 
falls into an 'extreme risk' category in the NHS National 
Patient Safety Agency's patient safety guidance risk 
matrix [39]. 'Extreme risk' requires urgent action by the 
highest level of an organization [39]. If the data presented 
in this review were used in the planning phase of a study 
comparing the outcomes of pre-hospital airway manage- 
ment in physician and non-physician systems, ethical 
approval would be difficult to obtain. 

One of the principles of recent pre-hospital anaesthe- 
sia guidelines is that patients undergoing pre-hospital 
anaesthesia should have the same standards of care and 
safety that they would receive in an emergency depart- 
ment [20]. This review suggests that physician-con- 
ducted pre-hospital intubation is associated with high 
levels of success that are similar to those reported in US 
emergency departments [40]. ETI attempted without 
drugs has not been associated with improved outcomes 
in cardiac arrest patients [41] and is only likely to be 
achieved in trauma patients with a high probability of 
mortality [42]. 

In previous studies of failed intubations in paramedic 
systems [43], it has been suggested that insufficient train- 
ing of the operators rather than their professional status 
may be responsible for the poor outcomes. Efforts have 
been made to train non-physicians in critical care 
[44,45]. Equipping non-physicians with drugs and train- 
ing them to conduct RSI raises a number of difficulties 
that need to be overcome. Both training and skill reten- 
tion are likely to be difficult, as using elective anaesthetic 
techniques without the need for intubation is becoming 
more frequent [45,46]. It is also important to ensure that 
the individuals trained to perform the complex RSI pro- 
cedure are matched with the few patients that require it 
and to provide the considerable resources necessary to 
run such programs. If all of these obstacles are overcome 



and significant resources are provided to train non-physi- 
cians to a high level, what failure rates can be expected? 
We compared the success rates of non-physicians trained 
to perform RSI with the success rates of physician- 
manned services and found that there was still a signifi- 
cant difference. The 2009 study by Warner et al. [14] 
described an exceptionally high level of training, supervi- 
sion and re-certification and reported on a relatively high 
number of ETIs. The paramedics were trained in a uni- 
versity training program with 2,500 hours of classroom, 
laboratory and field experience. Their ETI skills were 
developed through lectures, intensive mannequin training 
and experience with patients in the operating room. Field 
ETIs were then attempted with strict direct supervision 
and medical oversight. The paramedics also participated 
in a comprehensive recertification program every two 
years. A minimum of twelve uncomplicated tracheal 
intubations per year was required for recertification, and 
failure to achieve this standard resulted in returning to 
the operating room for further supervised training. 
Despite their high level of training, the paramedics in this 
program still failed to intubate 3 out of 100 patients after 
administering muscle paralytics (three times the failure 
rate of physicians), which raises significant patient safety 
issues. 

Limitations 

The results of the analysis in this study must be inter- 
preted with caution due to the small numbers in the 
patient sub-groups, although the findings remain signifi- 
cant and have narrow CIs. Selection bias, missing cases, 
and reporting bias in publishing may be conducive to 
including studies not necessarily representative of real- 
time clinical activity and performance. The long time 
frame for including studies and the variance in the 
reported success rate may diminish this. 

This review did not consider a number of other factors 
that may contribute to poor outcome. Sub-optimally per- 
formed ETI, such as multiple intubation attempts, hyper- 
or hypoventilation and unrecognized oesophageal intuba- 
tion, may be critical to outcomes and not reflected by 
intubation success rates. A high rate of undetected oeso- 
phageal intubation has been reported in non-physician 
systems and continues even after introducing easily used 
carbon dioxide detection equipment [5]. We also did not 
examine whether non-physicians are better or worse 
than physicians at managing the consequences of failed 
ETI. Even in physician-manned services, lack of training 
and sub-optimal recognition of the indications for 
advanced airway management may influence outcomes 
[47-49]. A recent report from a European group of pre- 
hospital critical care researchers and physicians identified 
pre-hospital airway management as a prioritized area for 
future research [50]. 
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Conclusions 

The results of this review suggest that EMS systems in 
which non-physicians perform ETIs have significantly 
more failed intubations than systems in which physicians 
perform ETIs. This increase persists in non-physician 
systems where muscle paralytics are used and where 
comprehensive training is provided. If pre-hospital anaes- 
thesia is to be conducted, it should be performed to the 
highest standards, which includes an intubation success 
rate close to 100%. This review suggests that this level of 
performance is currently found only in physician-manned 
services. Substituting existing physicians with even well- 
trained non-physicians brings with it significant patient 
safety issues. It may be that where pre-hospital EMS -phy- 
sicians are not available, concentrating on basic and 
advanced airway management techniques other than ETI 
should be strongly considered in a highly performing 
EMS system. 

Key messages 

♦ Pre-hospital emergency tracheal intubation (ETI) is 
provided by both physicians and non-physicians, and 
the published studies report a wide range in success 
rates from different emergency medical service (EMS) 
systems. 

♦ EMS-physicians have ETI success rates close to 
100% and significantly higher than non-physicians. 

♦ ETI is a potentially hazardous intervention, espe- 
cially when conducted with muscle paralytics, and 
failed intubation increases the risk of severe adverse 
events and fatal outcome. 

♦ In the absence of pre-hospital physicians, conduct- 
ing basic and advanced airway techniques other than 
ETI should be strongly considered. 
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Additional file 1: Overview of included studies. Aim of study, EMS 
manning, drugs available on scene, number of ETI attempts, number of 
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emergency tracheal intubation; RSI, rapid sequence induction. 
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